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(54) Video splldng apparatus and video splldng method 



(57) A video spfidng apparatus is provkled for 
receiving a transport stream including a plurality of 
packetized encoded vkleo data streams, and for spGc- 
ing the encoded video data streams to generate a 
spliced vKleo data stream. The vkleo splicing apparatus 
includes an input processor for disassemtsiing each of 
the plurality of packetized encoded vkleo data streams 
in the transport stream into a pseudo-elementary 
stream before packetization, and for storing the cfisas- 
sentbled pseudo-elementary streams in predetermined 
storage. An analyzer is also provided for analyzing the 
anK)unt of coded bits of two data streams of the pseudo- 
elementary strean^ stored in the storage that will be 
generated upon decoding upon receipt of the two data 



streams to be subjected to a splicing operation. A data 
processor is provkied for readng the data streams to be 
subjected to the splicing operation from the storage, 
splicing the streams. on6 Inserting a desired amount of 
additional data at a splice point k>ased on the result of 
(he analysts by said analyzer to produce a spliced video 
data stream and storing the spticed vkleo data stream in 
the storage. An output processor is provkied for deter- 
mining output timing for the spliced video data stream 
based on the determined amount of coded bits, and out- 
putting the spficed video data stream read from the stor- 
age based on the output timing. 
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Description 

BACKGROUND OF THE INVENTION 

10001] The present invention relates generally to a s 
video splicing apparatus and a video splicing method 
and more particularly to a video splicing apparatus and 
a video splicing method that are particularly suitable for 
switching and connecting packetized encoded video 
data streams, for example transport stream (TS) pack- io 
etized video data. 

[0002] A variety of compression encoding schemes 
have been proposed as techniques for reducing the 
amount of Information necessary to encode and repre- 
sent video images and audio information associated is 
therewith. A representative one of such compression 
encoding schemes is called Moving Picture Experts 
Group Phase 2 (MPEG2) that has been standardized by 
institutes such as the International Organization for 
Standardization (ISO) and so on. The MPEG2 compres- 2o 
sion encoding scheme has been standardized for pur- 
poses of transmitting video and audio data, and 
Includes separate standards for video and audio data, 
respectively. 

[0003] Digital broadcasting systems have recently 2S 
been devised for compression encoding video and 
audk) data using the MPEG2 conpression encoding 
scheme to transmit broadcast compression encoded 
data using ground or satellite waves, in operation, such 
a digital broadcasting system packatizes encoded video 30 
data and associated audio data for every predetermined 
tA(xk of data for transmission, and transmits a resulting 
sequence of padcets in a transport stream. (The packet 
sequence is hereinafter refenred to as the *1ransport 
stream" and each packet forming the transport stream is 35 
hereinafter referred to as a transport stream (TS) 
packet). 

[0004] Making reference first to Figs. 1 A to ID, the 
relationship between video data, audio data and TS 
packets will be explained. While a description of only the 40 
video data will be given, the same basic concept is 
applicable to both video and audio data. As is shown in 
Figs. 1A and IB, in accordance with the MPEG2 com- 
pression encoding scheme, several consecutive pic- 
tures are defined as one group of pictures (GOP), such 45 
that video data is compression encoded in units of GOP. 
At least one of the pictures in each GOP is defined as 
an I -picture and is compression encoded by intra-frame 
encoding, while each remaining picture is defined as 
either a P-pidure and is compression encoded by inter- so 
frame predictive encoding from the l-picture or another 
P-picture; or a B-picture and is compression encoded 
by bi-directional inter-frame predictive encoding from 
either I, P or B-pictures located before and after the B- 
picture. 55 
[0005] A plurality 0I encoded video data in GOP units 
are generally referred to as an "elementary stream 
(ES)" because this combination of encoded video data 



represents a material data element. As illustrated in 
Figs. 1 B and 1 C, the encoded video data GOPs are col- 
lected and placed in consecutive locations. A header is 
added at the head of the collection of the encoded video 
data GOPs to form a packetized elementary stream 
(PES). As is further illustrated in Figs. 10 and 10, the 
PES is divided every 184 bytes, and a 4-byte header is 
added to the head of each divided 184 byte packet. In 
this manner, the PES is transformed into a plurality of 
TS packets for transmission, the TS packets including 
the video data. 

[0006] As is illustrated in Fig. 2, a header provided 
with each of the PES packets comprises a 24-bit packet 
start code indicative of the start of the PES packet; an 8- 
bit stream ID indicative of the type of data stream con- 
tained in a data portion of the PES packet (for example, 
the type such as video, audio, or the like); a 16-bit 
packet length indicator that is indicative of the length of 
subsequent data portion; code data set to the value 
"1 0"; a 1 4-bit flag control field for storing a variety of flag 
information; an 8-bit PES header length variable indica- 
tive of the length of data in a following conditional coding 
fieki: and a variable-length condtional coding fiekJ for 
storing time management information such as timing 
information for use during reproduction and output 
called a presentation time stamp (PTS), time manage- 
ment information used difing decoding called a decod- 
ing time stamp (DTS). other time management data, 
and duffing bytes, as necessary, for adjusting the 
anrx3unt of data or ttie lika 

[0007] Referring next to Fig. 3. tiie 4-byte header of 
each TS packet comprises an 8-bit synchronization byte 
indicative of the start of the TS packet; an error display 
field indicative of the presence or absence of bit errors 
in the packet (error Indicator field); a unit start display 
fletel indicative of whether or not the head of a PES 
packet exists in this TS packet: a transport packet prkv- 
ity field indicative of relative significance of tills TS 
packet; a PID field for storing packet identification infor- 
mation (PID) indicative of tiie type of data stream con- 
tained in a payload field of this TS packet; a scramble 
control field indicative of whether or not the data stream 
contained in the payload field is scrambled; an adapta- 
tion field control field indicative of whether or not an 
adaptation field area and a payload area exist in this TS 
packet; and a cyclic counter field for storing cyclic coun- 
ter information indicative of whether or not a TS packet 
having the same packet identification information PID 
has been discarded. 

[0008] An adaptation field area for storing a variety of 
additional control information is also provided. The 
adaptation field area in turn includes an adaptation field 
length field area indicative of the length of the adapta- 
tion field area itself; a discontinuity display field indica- 
tive of whether or not timing information is to be reset in 
a TS packet of the same data stream subsequent to this 
TS packet; a random access display field indicative of 
whether or not this TS packet is an entry point for ran- 
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dom access display of the data stream: a stream priority 
display field incficative of whether or not the payload 
area of this TS packet contains a significant portion of a 
data stream: a flag control field for storing flag infonma- 
tion related to a conditional coding field; a conditional 5 
coding field for storing various reference time informa- 
tion including a program clock reference (PGR) and an 
original program clock reference (OPCR), infornnation 
such as a splice count down indicative of the number of 
bytes until a data exchange point; a transport data w 
length indication, and an adaption field extension indic- 
ative of whether additional adaption field information is 
to be provided; and a stuffing byte field including a plu- 
rality of stuffing bytes, as necessary, for adjusting the 
cimount of data. rs 
[0009] When transmitting data compression encoded 
infornr^tion employing the MPEG2 compression encod- 
ing scheme, because data to be transmitted is trans- 
formed into TS packets for transmission, as mentioned 
alxn/e. TS packets generated from other data may be 20 
multqalexed with the original generated TS data to be 
transmitted, and the combined data stream may be 
transmitted in a multiplexed manner. For this reason, a 
digital broadcasting system fiist compression encodes 
video and associated audio data of respective programs 25 
in accordance with the MPEQ2 oompression encoding 
scheme, then transfbnms ttiis oorrpression encoded 
data into TS packets, and finally miitipleKes these TS 
packets with TS packets including data from other pro- 
grants so that a plurality of programs can be broadcast 30 
through one line. 

[0010] When a plurality of programs are mutt|)teKed 
together and are transmitted on a single line, a receiver 
that receives such a miitiplexed data stream must 
extract and decode the TS packets containing video and 35 
audio data of a single viewer desired program from all of 
the multiplexed TS packets sent in the single multi- 
plexed data stream. In order to properly perform this 
process, the digital broadcasting system also trans- 
forms various program information, including a program 40 
association table (PAT) and a program map table (PMT), 
into TS packets which are then multiplexed and trans- 
mitted with the stream of TS packets associated with 
video and audio data, as described above. 
[001 1] The program information PMT includes packet 45 
identification information PID for each broadcast pro- 
gram information indicative of which of the TS packets 
contain video data and audio data forming part of a pai - 
ticular program. For example, for a program number "X". 
video data associated with this program number is iden- so 
tified with packet identification information PID "XV" and 
audio data associated with this program number is iden- 
tified with packet identification information PID "XA." 
Because program information PMT is provided for each 
program that is multiplexed together and transported in 55 
one multiplexed data stream, the number of program 
information PMT is equal to the number of programs 
multiplexed in a single multiplexed transport stream. 



[0012] The program infonmation PAT includes packet 
identification information PID for each of the broadcast 
programs indicative of which of the TS packets stores 
program information PMT for each program. For exam- 
ple, a TS packet storing program information PMT asso- 
ciated with program number "0" is identified by packet 
identification information PID "AA." and a TS packet 
storing program information PMT associated with pro- 
gram number "r is identified by identification informa- 
tion PID "BB." A TS packet which contains the program 
information PAT is additionally provided with predeter- 
mined packet identification information PID. 
[0013] When a receiving apparatus employed by a 
viewer receives a multiplexed transport stream having a 
plurality of programs multiplexed therein and a desired 
program is to be displayed, the viewer first receives at 
tfie receiver a TS packet which contains the program 
information PAT The receiver extracts the TS packet to 
acquire the program information PAT. Then, the receiver 
employed by the viewer references the acquired pro- 
gram infomnatton PAT to determine which of a plurality 
of TS packets contains the program information PMT of 
the desired program and to allow the receiver to acquire 
the program information PMT of the desired program. 
The receiver thus extracts the program tnf6nmat»n PMT 
of the desired program. Then, the receiver selects the 
TS packets that contain video data and audio data of 
the desired program from the TS packet data stream by 
referencing the acquired program information PMT, to In 
turn acquire the TS packets containing the actual vkleo 
and audio data fbrming the desired program. The 
acquired vkJeo and audio data is then decoded lor dis- 
play In this manner, the receiver can receive and dis- 
play any program desired by the viewer even if a 
pluraPity of programs are multiplexed together and are 
transported in a serial manner in a multiplexed transport 
stream 

[0014] According to one aspect of the digita] broad- 
casting system as described above, it is contemplated 
ttiat a multiplexed transport stream will be received at a 
local broadcast station, and that advertising video data 
(so-called CM), for exanple, will be inserted Into video 
data of a predetermined program witiiin the transport 
stream. After this insertion procedure is complete, the 
transport stream with the advertising video data 
inserted therein is retransmitted. It is also contenplated 
tiiat additional video data may be spliced to video data 
of a desired program within a transport stream, prior to 
final transmission, rather than being inserted within the 
video data of the desired program to be displayed after 
tfie transport stream has been produced at a main 
broadcasting station. The resulting transport stream is 
eventually transmitted from ttie local broadcasting sta- 
tion after the new data has been added thereto. As is 
illustrated in Figs. 4A to 4C. in order to perform such an 
editing operation, original video data SI and video data 
S2 to be inserted into video data Si or connected to 
video data 81 must be switched and connected to pro- 
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duce video data S3 which is intended tor final transmis- 
sion. Such a video editing operation is generally 
referred to as a "splicing operation." 
[0015] When baseband video data not subjected to 
compression encoding is to be spliced, the editing oper- 
ation can be readily carried out by switching the frame 
timing between the first and second video data S1 , 82 in 
synchronism. However, if the first and second video 
data have been compression encoded and then trans- 
formed into TS packets as mentioned above, the 
amount of information used to represent each picture 
differs from picture to picture. Thus, because the chang- 
ing points of images are not at equal intervals as is the 
case of conventional frames, difficulties In performing 
the splicing operation are caused. 
[001 6] Also, when a TS packetized transport stream is 
transmitted, the rate of the data transmission Is control- 
led to prevent a video buffering verifier (VBV) buffer of a 
system target decoder (STD) buffer, provided at an 
input stage of a receiver, from overflowing or underf tew- 
ing. Thus, sinrply switching the data input from the first 
video data to the second video data nriay possibly cause 
the STD buffer to overflow. For example, as Illustrated in 
Figs. 5A to 5C, if the first and second coded video data 
81 , S2, controlled to prevent the VBV buffer from over- 
flowing, are simply witched at the timing of time point ti 
to produce the third coded video data stream S3, a time 
period 12 from the decoding of the last picture m of the 
first coded video data 81 to the decoding of the first pic- 
ture n of the second coded video data 82 exceeds 1/30 
of a second, thereby causing the temporal relationship 
between the first and second coded video data SI, 82 
to be discontinuous before and after a connection point 
t1. In addition, if video data is extracted from the STD 
Ixiffer at intervals of 1/30 seconds in such a discontinu- 
ous state the STD buffer will underfkw in the near 
future. 

[0017] Thus, the use of T8-packetized video data 
results in a problem that a splicing operation cannot be 
performed simply by switching video data from a first 
video data stream to a second video data stream. 
[0018] It is therefore an object of tills invention to pro- 
vide an improved video splicing apparatus and a 
method associated therewith that alleviate the draw- 
backs of the prior art. 

SUMMARY OF THE INVENTION 

[001 9] Particular and preferred aspects of tiie present 
invention are set out in the accompanying independent 
and dependent claims. Features of the dependent 
claims may be combined wrth features of the independ- 
ent claims as appropriate, and in combinations other 
than those explicitly set out in the claims. 
[0020] In accordance with an embodiment of the 
invention, a video editing apparatus is provided for 
receiving a video data transport stream, including a plu- 
rality of packetized encoded video data streams multi- 



plexed together, and for splicing a desired encoded 
video data stream to the received video data to-ansport 
stream. The video editing apparatus comprises an input 
processor for disassembling each of the packetized 

5 encoded video data streams of the received video data 
transport stream into a form similar to an original ele- 
mentary data stream (before packetization), and for 
storing each disassembled elementary data stream in 
predetermined storage. An analyzer is provided for ana- 

/o lyzing the amount of coded bits that will be generated 
upon receipt for each data stream to be spliced to one 
of the elementary data streams stored in the predeter- 
mined storage. A data processor reads the data 
streams to be spliced to one of tiie elementary data 

15 streams from tiie predetermined storage. The elemen- 
tary data stream and the data stream to be spliced to 
the elementary data stream are spliced and a desired 
amount of stuffing data is inserted at a splice point 
based on a result of the analysis by the analyzer, to pro- 

20 duce a combined, continuous video data stream. The 
combined video data stream is tiien stored in the prede- 
termined storage, and an output timing for tiie combined 
video data stream is determined based on the amount 
of code bits that will be generated upon rece^ for the 

25 combined video data stream. The connbined video data 
stream is finally read from the predetemnined storage 
and is output based on the determined output liming. 
(P021 ] In accordance with embodiments of the inven- 
tion, respective encoded vktoo data streams within the 

30 received video data transport stream are cEsassembled 
into their respective original elementary data streams, 
and are staed in the predetermined storage. The 
anfx)unt of coding bits that wilt be generated upon 
receipt for data streams to be spliced to the pluraHty of 

35 elementary data streams is analyzed, and based on tiie 
result of this analysis, the streams are spliced together, 
and a required amount of stuffing data is inserted at a 
link point to produce a continuous combined vkieo data 
stream. The combined video data stream is output in 

40 accordance with an output timing determined on the 
basis of the annount of coding bits that will be generated 
upon receipt of the combined video data stream at a 
receiver. Thus, in accordance with embodiments of the 
invention, it is possible to readily carry out data connec- 
ts tion/splicing processing even with digital video data 
which is packetized for f ansmission, without causing a 
buffer in a receiver to underflow or overflow, and without 
causing a discontinuity in the output data. 
[0022] The apparatus and method of embodiments of 

50 the present invention allow for the splicing of TS-pack- 
etized video data while avoiding the risk of the produc- 
tion of discontinuous video data, or an underflow or 
overflow of the STD buffer. 

[0023] An embodiment of the invention provides an 
55 improved video editing apparatus and method that can 
readily perform a splicing operation of coded digital 
video data that has been packetized for transmission. In 
preferred embodiments, the apparatus and method 
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avoid a discontinuity in the output data in the vicinity of 
the splicing operation. Further, the - apparatus and 
method avoid underflow or overflow of a VBV buffer pro- 
vided In a system target decoder (STD) buffer. 
(0024] The invention accordingly comprises the sev- s 
eral steps and the relation of one or more of such steps 
with respect to each of the others, and the apparatus 
embodying features of construction, combinations of 
elements and an^angement of parts that are adapted to 
effect such steps, all as exenrplified in the following 10 
detailed disclosure, and the scope of the invention will 
be indicated in the claims, 

(0025] Still other objects and advantages of the inven- 
tion will in part be obvious and will in part be apparent 
from the specification and drawings. is 

P RI^F PES C RI PTIQN OF THE PRAWINg? 

(0026] The present invention will be described further, 
by way of example only, with reference to prefen^ed 20 
embodiments thereof as illustrated in the acconnpanying 
drawings, in which: 



Fig. 12 is a schematic diagram showing the struc- 
ture of a P ID lookup table in accordance with an 
embodiment of the invention; 
Rg. 13 is a block diagram illustrating the configura- 
tion of a P ID lookup table circuit constructed in 
accordance with an embodiment of the invention; 
Rg. 14 is a block diagram illustrating the configura- 
tion of a parser unit constructed in accordance with 
an entDOdimerrt of the invention; 
Rg. 15 is a block diagram illustrating the configura- 
tion of a data link circuit constructed in accordance 
with an embodiment of the invention; 
Rg. 16 is a block diagram illustrating the configura- 
tion of an output processor constructed in accord- 
ance with an embodiment of the invention; 
Rg. 17 is a flow chart illustrating a processing pro- 
cedure for a splicing operation in accordance with 
an embodiment of the invention; 
Rgs. 18A to 181 are timing charts of a processing 
schedule performed in various circuit elements in 
accordance with an embodiment of the invention; 
Rg. 19 is a diagram depicting the determinatbn of 
the required blanking and stuffing information 
required for a splicing operation in accordance with 
an emixxliment of the invention; and 
Rg. 20 is a ftow chart depicting the procedure to be 
followed In making the determinations In Rg. 19. 

DETAILED PESCRIPTIQN QF THE gMBQDIMgMT 

(1) General Configuration of a Splicing Apparatus Con- 
structed in Accordance with an embodiment of the 
Invention. 

[0027] Referring first to Fig. 6, a splicing apparatus 1 . 
is shown. In accordance witfi an emtxxJiment of the 
invention, control information is sqpplied from an exter- 
nal host computer 2. and in accordance therewith, splic- 
ing apparatus 1 splices together pre-selected programs 
from mutti-program transport streams S10. S11. Splic- 
ing apparatus 1 preferat^y resides in a main broadcast- 
ing station or in a local broadcasting station witiiin a 
digital broadcasting system and operates to splice 
together video data of two different programs which 
have each been previously transformed into transport 
streams for transmission. 

[0028] Making further reference to Rg. 6. the principle 
of a splicing operation performed in splicing apparatus 1 
in accordance vAth an embodiment of the invention will 
be explained. Assume first that the transport stream 
S10 is multiplexed with digital video data of three pro- 
grams A. 0. E. while the transport stream 811 is multi- 
plexed with digital video data of three programs B. D, F, 
arxi video data DB of program B is to be spliced into 
video data DA of program A. When transport streams 
S10, 811 are input to splicing apparatus 1, the splicing 
apparatus first rearranges and groups respective video 
data within transport streams 810. Sll for each pro- 



Figs. 1A to 1D are schematic diagrams used for 
explaining the structure of video data and a TS ^ 
packet employed in a standard apparatus; 
Fig. 2 is a schematic diagram illustrating the struc- 
tix^e of a PES packet employed in a standard appa- 
ratus; 

Fig. 3 is a schematic diagram illustrating the struc- so 
ture of a IS packet employed in a standard appara- 
tus; 

Figs. 4A to 4C are schematic diagrams used for 
explaining the concept of a splicing operation 
enployed in a prior art device; 3S 
Ftgs. 5A to 5C are schematic diacp'ams of an occu- 
pancy of a VBV buffer used for es^laining a draw- 
t}ack arising from a conventional splicing operation; 
Fig. 6 is a block diagram illustrating the configura- 
tion of a splicing apparatus constructed in accord- 40 
ance wKh an embodiment of the invention; 
Figs. 7A to 7C are schematic diagrams of an occu- 
pancy of a VBV buffer used for explaining a splicing 
operation in accordance with an embodiment of the 
invention; 45 
Figs. 8A to 8D are schematic diagrams of data 
sti'eams used for further explaining the splicing 
operation in accordance with an embodiment of the 
invention; 

Fig. 9 is a block diagram illustrating the configura- so 
tion of signal input processor constructed in accord- 
ance with an embodiment of the invention; 
Fig. 10 is a diagram showing a data structure for- 
mat when stored in a memory constructed in 
accordance with an embodiment of the invention; 55 
Fig. 1 1 is a block diagram illustrating the configura- 
tion of a sync detector circuit constructed in accord- 
ance with an embodiment of the invention; 
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gram based on packet identification information PiD 
included within transport streams S10, S11. The loca- 
tion packet identification information PID for each pro- 
gram in the transport stream may be recognized 
according to program information PAT . and program 
information PMT also included with each transport 
stream, as noted above. 

[0029] When the video data DA, DB of the programs 
A, B are spliced together, the video data is controlled so 
that a VBV buffer in a receiver of the spliced data will not 
overflow or underflow. As is illustrated in Figs. 7A and 
78, when the video data DA is spliced to the video data 
DB at time point t1, the video data DA is not simply 
switched to the video data DB. Rather, as illustrated in 
Rg. 7C, three blanking pictures B1 to 83 are inserted 
after the video data DA, and stuffing data SF is inserted 
to produce a spliced video data DAB such that the video 
data DA and the video data DB appear continuous 
before and after the splice point t1 . Consequently, when 
the spliced video data DAB is nxjltiplexed with video 
data of other programs C. E and transmitted, the VBV 
buffer at the receiver side of the apparatus will not over- 
flow or underflow as in the prior art apparatus even if the 
video data DAB is extracted at intervals of 1/30 seconds 
from the VBV buffer at the receiver. In this example, 
three blanking pictures are displayed between a last pic- 
ture m of video data DA and a first picture n of video 
data DB. Stuffing data SF is mere dunmy data for time 
adQustment, and is discarded by the receiver after the 
spficed video data DAB is extracted from the VBV buffer 
at the receiver end. 

[0030] The vkleo data DA and DB are TSi3acketized 
data multiplexed in the transport streams 810, S11, 
respectively, tf the complete vkleo data DA and DB were 
each stored in one IS packet, the splicing operation 
couM easily be performed in units of IS packets. Actu- 
ally, however, since the capacity of a TS packet is small, 
i.e., 188 bytes, the complete video data DA and DB are 
each stored over a plurality of TS packets: For this rea- 
son, in order to perform the splicing operation in the 
prior art, it is necessary to completely decode the video 
data and return the video data to the format of an ele- 
mentary stream. However, if the video data DA and DB 
are returned completely to the format of elementary 
streams, they must be again transformed into TS pack- 
ets to be output, thus requiring complicated processing. 
To avoid such difficulties, splicing apparatus 1 of an 
embodiment of the Invention converts the video data DA 
and DB, formed of TS packets, intodata having a format 
that can be handled as it formed of elementary streams, 
but that requires far less processing than if the data 
were actually converted to elementary streams. A proc- 
essor for performing this data format conversion is 
shown at input processing unit 3 of Fig. 6. 
[0031] Referring once again to Fig. 6. explanation of 
splicing apparatus 1 will be continued As is illustrated in 
Fig. 6. splicing apparatus 1 is generally composed of 
input processing unit 3: a data analysis unit 4: a data 



processing unit 5: an output processing unit 6; a centra! 
processing unit (CPU) 7, acting as a control means; a 
command bus 8; a data bus 9; a memory 10; and an 
interface unit 11. 

s [0032] CPU 7 controls the operations of the respective 
circuit elements (3-6. 1 0) of splicing apparatus 1 , CPU 7 
receives a splicing instruction from higher-level external 
host computer 2 through interface unit 1 1 and via com- 
mand bus 8. CPU 7 then issues operation instructions 

w to the respective circuit elements (3-6. 1 0) based on the 
received splicing instruction. The operation instructions 
are provided to the associated circuit elements (3-6. 10) 
via command data bus 8. In this manner the splicing 
operation instructed by host computer 2 is candied out. 

15 CPU 7 operates based upon an operation program 
stored in memory 10 to control the operation of these 
circuit elements. The operation program may be down- 
loaded into memory 10 through host computer 2 from 
the outskie. or input into memory 10 in some other man- 

20 ner. by way of example. 

[0033] In splicing apparatus 1. the respective circuit 
elements (3-7) are connected to memory 10 through 
data bus 9 such that they can write desired data Into 
memory 10 and read desired data from menrtory 10. 

25 Data bus 9 is provkled with an arbitration function for 
arbitrating access rights to data bus 9 so as to prevent a 
collision of requests for access to memory 10. 
[0034] Input processing unit 3 peribnms predeter- 
mined input processing on irput transport strean« S10. 

30 S11 suppGed thereto firom an outskie source. These 
processed input transport streams are then stored in 
memory 10. Input processing unit 3 is comprised of 
input processors 15A. 15B, and PID lookup tables 16A, 
16B such that the stpplied transport streams S10. S1 1 

35 are received by irput processors 1 5A, 1 56. respectively. 
[0035] Input processor 1 5A writes respective TS pack- 
ets of the input transport stream S10 into memory 10. 
making reference to PID lookup table 16A to rearrange 
and group transport stream S10 by program in accord- 

40 ance with packet identification information PID con- 
tained therein. The respective TS packets in transport 
stream S10 are then written into memory 10. Input proc- 
essor ISA performs data format conversion processing 
and records the respective TS packets that can then be 

45 handled as if they were elementary data streams into 
memory 10, as mentioned above. PID lookup table 16A 
stores address information for rearranging and grouping 
the respective TS packets by program in accordance 
with the packet identification information PID, and writ- 

50 ing the rearranged TS packets into memory 10. The 
address information can be read from PID lookup table 
16A with the packet identification information PID used 
as a key word. In this manner, input processor ISA can 
access PID lookup table 16A with the packet identifica- 

55 tion information PID as a key word to retrieve a desired 
write addresses in memory 10. in order to determine at 
what location in memory 10 each TS packets is stored. 
[0036] Input processor 1 58 and PID lookup table 16B 
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are configured substantially in a similar manner to input 
processor ISA and PID lookup table 16 A, respectively. 
Input processor 15B writes respective TS packets of the 
input transport stream S11 into menrory 10 with refer- 
ence to PID lookup table 16B to rearrange transport 
stream S11 in accordance with packet kientification 
information PID. The respective TS packets in transport 
stream Si 1 are then written into memory 10. 
[0037] Data analysis unit 4 reads out video data DA 
and DB from memory 10 that are to be subjected to a 
splicing operation, and then parses the syntax of video 
data DA and DB, the PES stream and the TS packet 
stream to retrieve the MPEG, PES and TS parameters. 
Data analysis unit 4 thus reads a variety of parameters 
that have been added to the desired TS packets during 
compresskxi encoding and packetization. Data analysis 
unit 4 then analyzes the anrK)unt of code that will be gen- 
erated for the video data DA and DB upon reception 
based on the retrieved parameters. 
[0038] The data analysis unit 4 comprises a parser 
unit 17 and a buffer simulator unit 18. Parser unit 17 
accesses memory 10 to parse the syntax of the 
encoded video data DA and DB to be spliced being 
treated as elementary streams, and the syntax of the 
PES and TS streams, and extracts a variety of parame- 
ters which have been added to the encoded vkJeo data 
and TS packets during compression encoding and 
packetization. Buffer simulator unit 18 in turn analyses 
the amount of code that will be generated in the VBV 
buffer at the receiver when the spficed video data DA 
and DB are received thereby, based on the parsing 
results derived by parser mit 17. Data analysts unit 4 
can calculate the occupancy of the VBV buffer at the 
receiver upon the receipt of video data DA and DB from 
the nunnber of bits of the video data DA and DB and the 
transport bit-rate of the video data DA and DB. CPU 7 is 
notified of the result of this analysis. CPU 7, upon 
receiving the analysis result, determines how the coded 
video streams should be spliced and formatted in order 
to prevent the VBV buffer of the receiver from overflow- 
ing or underflowing. and notifies data processing unit 8 
of this information as a splicing instruction. The analysis 
result output from buffer simulator unit 18 and the data 
combination information output by CPU 7 are also sup- 
plied to a scheduler circuit 24 in output processing unit 
6. 

[0039] Data processing unit 5 splices the video data 
DA and DB in response to a splicing instruction from 
CPU 7. Data processing unit 8 is composed of a data 
link circuit 19; a blanking generator 20; and a stuffing 
generator 21. Data link circuit 19. responsive to a data 
combination instruction from CPU 7. reads the video 
data DA and DB to be spliced from memory 10, and 
splices the video data to produce combined video data 
DAB. Data link circuit 19 inserts a desired amount of 
blanking data and stuffing data, generated by the blank- 
ing generator 20 and the stuffing generator 21, at a 
splice point of video data DA and DB. This blanking data 



and stuffing data is inserted as necessary in order to 
prevent the VBV buffer from failing. 
[0040] H is not necessary for data link circuit 1 9 to read 
all of the video data DA and DB which are to be spliced. 

5 As illustrated in Rgs. 8A to 8C. data link circuit 19 reads 
video data DA1 and DB1 only near the splice point as 
required for the splice processing. Thus, video data DA1 
and DB1 are spliced together, blanking data and stuffing 
data are inserted between the video data DAI and DB1 

10 to produce spliced video data DA+B. This spliced video 
data is then stored in memory 10 in TS packet form. 
Spliced video data DA+B can be readily produced upon 
data output by reading the video data from memory 10 
in a desired order. 

15 [0041] Output processing unit 6 reads and outputs a 
desired portion of video data stored in memory 10 to 
multiplex the combined video data DA+B. and video 
data that has not been spliced, such as programs C. E, 
to output the multiplexed video data as a transport 

20 Stream Sq^t Specifically, output processing unit 6 
reads partial video data DA2 of video data DA, subse- 
quently reads the linked vKleo data DA+B, and further 
reads partial video data DB2 of video data DB to output 
the spliced vkf eo data DA+B, as illustrated in Rg. 8D. In 

25 parallel, output processing unit 6 reads TS packets of 
video data of the unspliced programs 0, E. These data 
programs are multiplexed with the spGced vkieo data 
DA+B. TS packets containing data of C, E programs are 
inserted between respective TS packets of conMied 

30 video data DA+B according to a predetermined timing. 
Transport streeun Sour >s thus output having the spliced 
video data DAB and the vkjeo data of unspliced other 
programs C, E multiplexed therein. 
[0042] CXflput processing unit 6 comprises a time 

35 Stamp regenerator 22 ; an output processor 23 ; a sched- 
uler circuit 24; and a PCR regenerator 25. Time stamp 
regenerator 22 adds a new time stamp information, 
such as PTS. DTS, and program dock reference PCR to 
tfie video data DB1 and DB2 which are connected after 

40 tfie splice point, and also adds required blanking pic- 
tures that are inserted between video data DA and DB 
by stuffing processing. Originally, tiie video data DA and 
DB each had their om\ time stamps added thereto to 
prevent the VBV buffer from overflowing or underflow- 
's ing. However, these time stamps likely do not match 
after tfie splicing operation. For this reason, time 
starrps may be possibly discontinuous before and after 
tiie splice point. To prevent this, time stamp regenerator 
22 detects time stamps added to the video data DA up 

50 to the splice point from the video data DA. and adds new 
time stamps continuous from the previous time stamps 
to the video data DBl and DB2 after the splice point. 
[0043] Scheduler circuit 24 estimates the amount of 
code that will be generated in the VBV buffer of the 

55 receiver upon receipt of the spliced data, and schedules 
the output timing of the TS packets of the video data 
DA2. DA+B arxl DB2 stored in memory 10 based on the 
analysis result output from buffer simulator 18 by CPU 
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7. Scheduler circuit 24 also schedules the output of the 
other non-spliced programs C, E. Then, scheduler cir- 
cuH 24 outputs the scheduling result to output processor 
23 as a scheduling list. The scheduling list may include 
entry infornnation for specifying which TS packet is to be 
output, and output time information indicative of the out- 
put timing for the TS packet arranged in a list form. 
Because most of the TS packets are input and output 
without modification, scheduler circuit 24 specifies an 
output time for a TS packet according to its input time 
(i.e., the value of a system time clock STC upon input of 
the TS packet) for simplifying processing. However, for 
TS packets positioned after the splice point within the 
spliced data stream, scheduler circuit 24 assumes that 
the TS packets in the spliced data stream are input to 
splicing apparatus 1 continuously after TS packets input 
before the splice point. Scheduler circuit 24 calculates, 
based upon this assumption, the value of a system time 
clock STC which is added to the input time for each of 
the TS packets, and specifies an output time for each of 
the TS packets in the spliced data stream. Output proc- 
essor 23 sequentially reads TS packets of the splrced 
video data DA+B and video data of the other programs 
C, E based on the scheduling list output from scheduler 
circiit 24, and outputs the read TS packets to PGR 
regenerator 25 as a transport stream Squt- 
[0044] PGR regenerator 25 adds a new program clock 
reference PGR to each TS packet in the transport 
stream Squt such that the program dock reference 
PGR is continuous over the TS packets. When the TS 
packets are sequentially outputted based on the sched- 
uling list produced by scheduler circuit 24, the reference 
time information PGR in the transport stream SOUT 
must t>e continuous. However, if output processor 23 is 
operated in accordance wHh an operating ckxk that is 
external to output processor 23. the timing at wNch TS 
packets are actually output may deviate from the sched- 
uling list possibly resulting in discontinuous program 
clock reference PGR. For this reason, in splicing appa- 
ratus 1 , program clock reference PGR in the transport 
stream Squt 'S corrected by PGR regenerator 25. PGR 
regenerator 25 adds the value of PGRnew as the pro- 
gram clock reference PGR, in accordance with the fol- 
lowing equation: 

PGRnew = PCRold +(STCreal - STCideal) (1 ) 

where PCRold is the program clock reference PGR cur- 
rently added to the transport stream Squt; STCideal is 
the time at which the transport stream Squt 'S sched- 
uled to be output, determined in accordance with the 
scheduling list; and STCreal is the time at which the 
transport stream Squt 'S actually output. Transport 
stream Bout- with newly added program clock reference 
PGR, is finally output from splicing apparatus 1. 



(2) Configuration of Input Processor 

[0045] The configuration of input processors 1 5 A, 1 SB 
will be described first making reference to Fig. 9 in addi- 
5 tion to Fig. 6. Because input processors ISA. 15B have 
a similar configuration, only input processor ISA will be 
described. 

[0046] As illustrated in Fig. 9, input processor 15A 
comprises a sync detector circuit 30; a format conver- 
ge sion circuit 31; and a PID detector circuit 32. Sync 
detector circuit 30 detects a synchronization byte code 
f 47H") added at the head of each TS packet in a trans- 
port stream S10 inputted thereto to detect the beginning 
of each TS packet. A sync pulse S20 indicative of the 

15 beginning of each TS packet is output to fonmat conver- 
sion circuit 31 and PID detector circuit 32 when the syn- 
chronization code is detected. 
[0047] P ID detector circuit 32 detects packet kjentif i- 
cation information PID added to each TS packet in 

20 accordance with the detection of sync pulse S20. 
Because the packet kJentification information PID is 
stored in an area a predetermined number of bits from 
the head of each TS packet. PID detector circuit 32 
counts the predetermined number of bits firom sync 

25 pulse S20. and detects the stored packet identification 
information PID. Then. PID detector circuit 32 sends the 
detected packet identirication infomnation PID to PID 
k>okup table 16A as a keyword. PID lookup table 16A 
receives this packet identification information PID, 

30 searches for address Information for rearranging TS 
packets in accordance with the packet identificat'on 
information PID for storage in memory 10, and sends 
resultant address information Sads to format conver- 
sion circuit 31 . f=ormat conversion circuit 31 receives the 

35 188-byte TS packet and the associated address infor- 
mation Sads each TS pack^ adds additional unique 
information to each TS packet, and stores each TS 
packet to which additional information has been added 
at an address position indicated by the address informa- 

40 tion Sads 

[0048] Taking advantage of the fact that memory 10 
stores information in units of 256 bytes, the additional 
information added by format conversion circuit 31 
includes 68 bytes before and after the 188-bytes in each 

45 TS packet, as illustrated in Fig. 10. Additional informa- 
tion included in the 68 bytes to be added may include 
various kinds of information as illustrated in Fig. 10. 
"abs_sum_bgn" is infornration indicative of the start 
address of pay load data of an associated TS packet. 

50 and "abs_sum_end'* is information indicative of the end 
address of the pay load data, "payloadjenglh" is infor- 
mation indicative of the length of the payload portion of 
the TS packet, and "payloadjotr" is pointer information 
pointing to a head of the payload portion of the TS 

55 packet. Also, "PGR _ptr" is a pointer information pointing 
to a head of program clock reference PGR in the TS 
packet, and is loaded with the value "Oxff ' when no pro- 
gram clock reference PGR is included in the TS packet. 
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[0049] "PES .jjyidjrtr" is a pointer information point- 
ing to a head of a payload portion of a PES packet, and 
is loaded with the value "Oxff" when no payload portion 
of a PES packet exists in the IS packet. 
"PES.pcktJngtjDtr- is a pointer information pointing to 5 
a head position at which a length of a PES packet is 
stored, and is loaded with the value "OxfT when no pay- 
load portion of a PES packet exists in the TS packet. 
''PES_hdrJngt_ptr" is a pointer information pointing to a 
position at which the length of a header of a PES packet w 
is stored, and is loaded with the value "Oxff" when no 
header of a PES packet exists in the TS packet. 
"splc_cntdwn" is pointer information pointing to a head 
position at which information on splice count down is 
stored, and is loaded with the value 'OxfT when such 15 
Information does not exist in the TS packet 
"splice.countdown" stores information Indicative of the 
value of splice count down for the TS packet. 
[0050] "PTS.ptr" is pointer Information pointing to a 
head position at which time information PTS in the TS 20 
packet is stored, and is toaded with the value *t)xfr 
when no time information PTS exists in the TS packet. 
*'DTS .ptr" is pointer Information pointing to a head posi- 
tion at which time infbnnatfon DTS In the TS packet is 
stored, and is foaded witti the value "OxfT when no time 25 
information TDS exists in the TS packet. "AUjitr* is 
pointer infbrmalion pointing to a head of an access unit 
and is loaded with the value *Y)xfr if no access unit 
exists in the packet "pr^-PCR' is infornnation indica- 
tive Off tiie nunber of a TS packet in whteh ttie previous so 
program dock reference PGR is stored, and 
V^.SPCD' is information indicative of the number of 
a TS packet in which the previous splice count down is 
stored. Also, Input. STC is the value of a system time 
dock STC when the TS packet is input, and TCR" is 35 
the value of program dock reference PGR in the TS 
packet 

[0051] By tfius adding a variety of pointer and ottier 
information indicative of positions of stored infbrmatbn 
when a TS packet is stored in memory 10. CPU 7 can 40 
directly access desired parameters to be used In the 
splidng operation. Thus, the TS packet can be handled 
as if it were an elementary stream by reading data at 
desired positions in the TS packet. Also, with the value 
of the system time cfock STC added as the time at 45 
which a TS packet was Input, a TS packet not si&jected 
to a splidng operation can be output without causing tiie 
VBV buffer to fail, by refening to this input time to output 
the TS packet at timing a predetermined time period 
delayed from the input time. Thus, such TS packets only so 
require scheduling processing only for registering the 
input time. Format conversion circuit 31 adds such addi- 
tional information to each TS packet input thereto to 
produce recording data 821 which is supplied to mem- 
ory 10. and rearranged in accordance with the packet 55 
identification information PID for storage in memory 10. 
[0052] Next, the configuration of sync detector circuit 
30 will be described making reference to Fig. 1 1 in addi- 
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tion to Fig. 6. Each TS packet in transport stream Si 0 is 
an equal-length data packet including a synchronization 
byte. However, since the data code word used to indi- 
cate the synchronization byte may also be used for 
other purposes, the same data code as that of the syn- 
chronization byte may appear in another portion of tiie 
TS packet. However, since all TS packets have the 
same length of 186 bytes, tiie synchronization bytes are 
positioned at regular intervals in transport stream S10. 
By performing a fly wheel processing in accordance 
with the regular positioning of the synchronization bytes 
in which tiie bytes are read as received, the synchroni- 
zation bytes can be correctly detected to produce a plu- 
rality of sync pulses S20 incficative of the timing of the 
starts of the respective TS packets. Sync detector cir- 
cuit 30 which relies on tiie fly wheel processing is con- 
figured as illustrated in Rg. 11. 
[0053] In sync detector circuit 30, three states are 
employed in the course of detecting synchronization 
t>ytes positioned in transport stream 810. One is a hunt 
state, and the remaining two are an unlock state and a 
lock state. In tiie hunt state, sync detector circuit 30 has 
lost the position of a synchronization byte arvl is looking 
for it In the unlock state sync detector drcuft 30 has 
detected a Kkel/ position of a synchronization byte but 
tiie determined position is not def biite. In the kxk state 
tiie drtenmined position of a 8yrK:hronlzation byte is def- 
inita Sync detector drcuit 30 begins with the hunt state, 
and transitions to the unlock state when it detects a byte 
considered likely to be a syndironization byXo, and fur- 
tfier transitions to the lock state when a predetermined 
condition is satisfied in the unlock state, and the position 
of the synchronization byte has been d^nftely deter- 
mined. Conversely, even once in the lock state or tiie 
unlock state, synch detector drcuit 30 will transition to 
ttie hunt state if it loses the synchronization byte. Sync 
detector circuit 30 can correctiy detect the synchronize* 
tion byte by reaching the k>ck state through the forego- 
ing state transitions. 

[0054] In sync detector drcuit 30, transport stream 
S10 is first input to a comparator 40. The comparator 40 
compares a value in transport stream S10 Inputted 
ttiereto with data *'47H" which is the value employed as 
the data code of the synchronization byte, and outputs a 
logical output at level "H"* if the value in transport stream 
S10 is coincident with ''47H'' and a logical output at level 
"L" if not coincident 

[0055] An AND circuit 41 takes a logical AND of state 
information DS-HT at level "H" indicative of the hunt 
state, output from a state decoder 88 later described, 
and the output of comparator 40. Because comparator 
40 outputs a logical output at level "H" if it detects a syn- 
chronization byte "47H" from transport stream 810, 
AND circuit 41 outputs a logical output at level "H" when 
sync detector circuit is in the hunt state, and a synchro- 
nization byte is detected. The logical output at level "H" 
of AND circuit 41 is input to a reset terminal of a clock 
counter 44 as next unlock information DN-ULK. The 
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next unlock information DN-ULK is also input to a state 
encoder 56. later desaibed to force a state change to 
the unlock state. When the next unlock information DN- 
ULK is generated, sync detector circuit 30 transitions to 
the unlock state to output state information DS-ULK 5 
indicative of the unlock state. 

[0056] A clock counter 44 cyclically counts from '^O" to 
"188" bytes, and its count value is forcibly reset to "0" 
upon receipt of each next unlock information DN-ULK at 
I ever H from each TS packet. " Clock counter 44 outputs 1 0 
a sync pulse S20 when its count value is "0." and out- 
puts a pulse signal Sdet determining whether or not 
a synchronization byte is definite when its count value is 
"188." For reference, the pulse signal Sq^j indicates the 
timing at which the next synchronization byte should be is 
detected after a synchronization byte has been 
detected. 

[0057] An AND circuit 42 determines whether or not 
comparator 40 has detected a synchronization byte 
when the pulse signal Sqet generated by taking a 20 
logical AND of the pulse signal Sq^j and the output 
from comparator 40. As a result, if comparator 40 has 
detected a synchronization byte at the time the pulse 
signal SDET was generated, AND circuit 42 outputs a 
logical output at level "H." A match counter 47 counts 25 
the number of pulses at \B/e\ "H* output from AND cir- 
cuit 42 to count the number of times the synchronization 
byte has been detected at the proper timing, and out- 
puts the count value to a comparator 48. 
[0058] Comparator 48 receives a defnition value 30 
Dmatch suppfied from CPU 7 tiirough a latch drcwt 46, 
and outputs a logical output at level "H" when tiie defini- 
tion value Dmaxoh becomes equal to the count value of 
match counter 47. An AND circuit 49 takes a logical 
AND of tiie state information DS-ULK indicative of the 35 
unlock state and tiie output of comparator 48. and out- 
puts next lock information DN-LK at level "H" at the tim- 
ing comparator 48 outputs a ksgical output at level "H." 
The next lock information DN-LK is input to state 
encoder 56, later described. When the next lock infer- 40 
mation DN-LK is generated, sync detector circuit 30 
transitions to the lock state to output state information 
DS-LK indcative of the lock state. When the synchroni- 
zation byte is detected equal to or more than a predeter- 
mined number of times from the time the 45 
synchronization byte was first detected as cotnted in 
match counter 47, sync detector circuit 30 can transition 
to the lock state and output the sync pulse S20 accu- 
rately synchronized with the synchronization byte. 
[0059] In order to detect t1 a synchronization signal so 
has been lost, an AND circuit 45 receives the output 
from comparator 40 through an inverting circuit 43 as 
well as the pulse signal Sq^j, and takes a logical AND 
of these signals. In this event, when the comparator 40 
outputs a logical output at level "L " and the timing the 55 
pulse signal Sqet 'S at level "H" (i.e., when the compa- 
rator 40 does not detect a synchronization byte at the 
expected timing), AND circuit 45 outputs a logical output 
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at level "H." A miss counter 50 counts the number of 
times a synchronization byte does not come at tiie 
expected timing by counting the number of pulses at 
level "H" of AND circuit 45. and outputs the count value 
to a conparator 52. Comparator 52 receives a definition 
value D|^,ss supplied from CPU 7 tiirough a latch circuit 
51, and outputs a logical output at level "H" when ttie 
definition value D^iss becomes equal to the count value 
of miss counter 50. An AND circuit 53 takes a logical 
AND of the state information DS-LK indicative of the 
lock state and the logical output of comparator 52, and 
outputs a logical output at level "H" if the status is in ttie 
lock state and comparator 52 outputs a logical output at 
level "H", indicating that a sync signal has been missed 
more tiian a predetermined number of times when in 
tiie lock state, 

[0060] An AND circuit 54 takes a logical AND of an 
output of AND circuit 45 and the state information DS- 
ULK indicative of the unlock state, and outputs a logical 
output at level *'H** if tiie status is in tiie unlock state and 
AND circuit 45 outputs a logical output at level "H", indi- 
cating that a single sync pulse has been missed when in 
the unlock state. An OR circuit 55 outputs next hunt 
iniomnation DN-HT at level "H" when eiflier of tiie AND 
circuits 53, 54 outputs at level "H/ The next hunt infor- 
mation DN-HT is input to the state encoder 56. later 
described. When the next hunt infbnnation DN-HT is 
generated, sync detector circuit 30 transitions to tiie 
hunt state and outputs ttie state information DS4fr 
indicative of tiie hunt state. In ttiis way, sync detector cir- 
cuit 30 is adapted to again transition to ttie hunt state to 
look for a synchronization t>yte when the synchroniza- 
tion byte is not detected equal to or more tiian a prede- 
termined number of times at tiie expected timing of tiie 
synchronization byte, in tiie look state, or when tiie syn- 
chronization byte is not detected at the expected timing 
in the unkx:k state. 

[9061] As described above, the next unbck infbmia- 
tion DN-ULK, ttie next lock information DN-LK. and tfie 
next hunt information DN-HT are converted into state 
information DS-ULK, DS-LK, DS-HT, respectively, after 
predetermined timing ttirough tiie state encoder 56, a 
latch circuit 57 and the state decoder 58. 

(3) Configuration of PID lookup Table 

[0062] PID lookup tables ISA and 16B will be 
described making reference to Figs. 12 and 13. in addi- 
tion to Fig. 6. Because PID lookup tables 16A and 16B 
have a similar configuration, only PID lookup table 16A 
will be described, it being understood that the descrip- 
tion applies equally well to Fig. 16B. 
[0063] PID lookup table ISA searches for. and pro- 
vides address information for rearranging and grouping 
TS packets in accordance with packet identification 
information PID and stores the rearranged TS packets 
in memory 10. The search for address information is 
started after a TS packet has been input to input proc- 
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essor ISA, and must be completed by the time a next 
IS packet reaches input processor ISA, so this next TS 
packet may be processed. Thus, fast operation is 
required. For this reason, PID lookup table 16A com- 
prises a plurality of tables that are used for the address 
search such that search processing is performed in par- 
allel. The plurality of tables allows for the search for 
address infornr\ation associated with the packet identifi- 
cation information PID specified by Input processor 15A 
at a higher speed. 

[0064] Each of the plurality of tables provided in PID 
lookup table 16A is structured as shown in the memory 
map of Fig. 12. Specifically, in each of tables TBI to 
TB4. address information is an-anged in discrete infor- 
mation packets and stored for each packet kientification 
information PID. The value of the packet dentification 
information PID is stored at the head of each infbmfia- 
tion packet as a search tag. For searching tabies TBI to 
TB4 in order to retrieve desired address informatk)n, a 
search tag is searched for to find an information packet 
in wNch address tnfbmnation corresponding to the 
desired packet klentification information is stored. Ortce 
the appropriate information packet has been found, 
address information stored at and subsequent to the 
search tag within the information packet is sequentially 
read and output therefrom. 

[0065] In Rg. 12. TIP VAL" indicates the value of 
packet klentificallon infbnnation PID used as a search 
tag; 'V/jTtr" indicates address information irxiicative of 
the write address at which an associated TS packet is to 
be stored in memory 10; and 'Information'' indicates 
address information to generate the additional infonma- 
tion stored together with the TS packet Memory 10 
stores TS packets in a ring buffer manner, and thus 
each address information is updated as required after it 
is read. 

[0066] The specific configuration of the apparatus for 
retrieving information from PID lookup table 16A will 
now be described making reference to Rg. 13. As is 
illustrated in Rg. 13. PID lookup table 16A comprises a 
plurality of refer^ice to circuit elements for performing 
desired actions on tables TBI to TB4 which store the 
aforementioned address information. First, packet iden- 
tification information PID outputted from PID detector 
circuit 32 of input processor ISA is supplied to each of 
comparators 61 A to 61 D through a latch circuit 60. 
[0067] A search start pulse SSP output from PID 
detector circuit 32 together with the packet identification 
information PID is supplied to a counter 62 and a fine 
counter 63. Counters 62 and 63 are provided for gener- 
ating an access position on each of the tables TBI to 
TB4, where counter 62 generates upper, most signifi- 
cant bits of an access position and fine counter 63 gen- 
erates lower, less significant bits of the access position. 
H only the output of the counter 62 is used to specify 
access positions, positions are specified at desired 
search tag intervals in the tables TBI to TB4. Therefore, 
when a count interval for counter 62 is set to the interval 



of search tags in tables TBI to TB4. the location of the 
search tags in the tables TB1 to TB4 can be specified by 
merely employing the output of counter 62 and not 
including the output of fine counter 63. Upon receipt of 

5 a search start pulse SSP, counter 62 begins a counting 
operation, and outputs its count value CNT1 to an 
address generator 64. Address generator 64 generates 
the address of an access position specified by the count 
value CNT1 of counter 62, and outputs the address to 

10 each of tables TB1 to TB4. Thus, tables TBI to TB4 are 
accessed at their first search tags, and the values of 
packet identification information PID in the first search 
tag from each of the tables is output to comparators 61 A 
to61D, respectively. 

15 [0068] Each of comparators 6 1 A to 61 D compares the 
value of packet identification infonnation PID supplied 
thereto through latch circuit 60 with the value of the 
packet klentification information PID output from each 
table TBI to TB4. and advances the count of the coun- 

20 ter 62 by one if none of the values are coincklent. This 
counter advancing allows a next search tag storing 
packet identification inforn^tion PID to be searched in 
each table. This operation is repeated until two values of 
the packet klentification information PID (one from latch 

2S circuit 60, and one from one of the tables) are coinci- 
dent. If it is determined that two values of the packet 
identification infonmatfon PID coinckJe, the comparator 
that has detected the desired PID infonnation coinci- 
dence, and stops the counting operation of counter 62. 

30 Rne counter 63 then begins a fine counting operation. 
Simultaneously a selector 65 selects the table in which 
the cotnckience was detected. Address information 
stored at the search tag onward is sequentially read by 
advancing the count of the fine counter 63 one by one 

35 since the count width of the fine counter 63 is equal to 
the infornr^on storing interval in each tali^e TBI to 
TB4. Thus, information associated with the desired PID 
information is output. The read address information is 
output to format conversion circuit 31 of input processor 

40 ISA as address information Sads through selector 65 
and a latch circuit 66. 

[0069] When address information stored in tables TB 1 
to TB4 is to be updated, new address information is 
supplied to a data update circuit 67 v\^ich updates the 

45 address information stored in each of the tables based 
on update information Dyp^ supplied from CPU 7. The 
updated address information is stored over previously 
stored address information in tables TBI to TB4 through 
a switch 68, thereby allowing for the update of the 

50 address information. For setting an initial value of the 
address information stored in the tables TBI to TB4, an 
initial value Dinj supplied from the CPU 7 is supplied to 
the tables TB1 to TB4 through the switch 68, and a stor- 
age location is specified through the address generator 

55 64. whereby the initial value Dij^j can be loaded at a 
desired position in the tables TBI to TB4. 
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(4) Configuration of Parser Unit 

[0070] Parser unit 17 will now be described making 
reference to Fig. 14, in addition to Fig. 6. As is shown in 
Fig. 6, parser unit 17 accesses memory 10 to parse TS 
packets which contain video data that is to be subjected 
to a splicing operation, and extracts a variety of coding 
parameters which have been added to encoded data 
during compression encoding and packetization. 
Parameter information to be extracted includes PES or 
TS parameters, including time intannation. such as 
presentation time stamp PTS. decode time stamp DTS, 
PGR, length of a PES packet, the length of a PES 
header, bit rate. VBV size bit_rate_exlenslon, 
VBV_size_extension. closed_GOP, 
temporary_reference, picture_coding_type, VBV_delay, 
topjieldjirst repeatJirstJiekJ, and so on. 
[0071] When an input transport stream is of a multi- 
program type, data streams having different packet 
identification information PID are mixed therein, so that 
a complicated operation is involved to extract parame- 
ters associated with each of these streams. However, 
because respective TS packets have been previously 
rearranged and stored in accordance with the pad<et 
identification infonnation RIO t>y the input processors, 
each rearranged stream can be parsed so ttiat parame- 
ter information associated therewith can be readily 
extracted. 

[0072] Qenerally, there are at least two or more video 
data streams which may be subjected to a splicing oper- 
ation. For this reason, parser unit 17 must parse the 
foregoing parameters for at least two or more video data 
streams. Parser unit 17 parses a plurality of video data 
streams to be subjected to a splicing operation in time 
division processing to extract the parameters for each 
data stream. When data streams are parsed in time divi- 
sion processing, parser unit 17 must hold the result of 
the parsing operation on a particular data stream so iar 
made when it proceeds to parse information from 
another stream, thus maintaining parallel collections of 
extracted parameters. For this operation, parser unit 17 
includes a status table 17A for storing unfinished pars- 
ing results. When parser unit 17 proceeds to parse a 
next data stream due to time division multiplex process- 
ing, a parsing result so far obtained is stored in the sta- 
tus table. 

[0073] The configuration of parser unit 17 is shown in 
Fig. 14. For example only, it will be assumed herein that 
a total number of streams to be subjected to a splicing 
operation is N, and to TS packets of these streams are 
added packet identification information PID as PID=>"1," 

"2." , "N" for the sake of explanation. Parser unit 17 

includes status table 17A formed for each data stream 
(i.e.. for each packet identification information) to store 
parsing results. Access to different portions of status 
table 1 7A is switched by a selector 1 7B, such that a por- 
tion of the table associated with a desired stream can be 
accessed in status table 1 7A. 
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[0074] First, a parser 1 7C reads from memory 1 0 data 
Djsi of a TS packet to be subjected to a splicing opera- 
tion and having packet identification information PID set 
at T. Selector 17B is controlled to connect parser 17C 

s with a portion of table 1 7A having the packet identifica- 
tion information PID set at T in the status table 17A. 
Parser 1 7C parses the syntax of the data Djsi of the TS 
packet in order to extract a variety of parameters as 
mentioned above. At the time a next data stream is to be 

w parsed, after the lapse of a predetermined time period 
from receipt of the first data stream, parser 1 7C stores 
the result of the parsing so far obtained in the portion of 
status table 17A having the packet identification infor- 
mation PID set at "r via selector 17B. 

15 [0075] Subsequently, parser 17C controls selector 
1 76 to connect parser 1 7C with a portion of status table 
1 7A having the packet identification information PID set 
at -2". Parser 1 7C reads data D jg^ of a TS packet hav- 
ing the packet identification information PID set at "2" 

20 from memory 10. and parses the syntax of the D-^^ 
data in order to extract parameters as mentioned above 
for the data stream having packet identif ication informa- 
tion PID set at "'Zr Then, at the time the next data 
stream is to be parsed, parser 17C stores the result of 

25 the current parsing operation so far obtained in the por- 
tion of status table 17A having the packet identification 
information PID set at "2" via selector 178. By subse- 
quently pertomiing the processing as described above 
in a similar manner at every predetermined time, conre- 

30 spending to tiie arrival of each data stream to be 
parsed, parser 1 7C parses the streams to be subjected 
to the splicing operatkxi in accordance with a time divi- 
sion multiplexing scheme. 

[0076] As a result, at the time the stream having the 
35 packet identification information PID set at *V is again 
to be parsed, parser 17C controls selector 17B to 
access the portion of the table having the packet identi- 
fication information PID set at "1 * to extract the previous 
parsing result, and sd3sequently reads tiie data D jsi of 
40 the next TS packet having tiie packet identification infor- 
mation PID set at "1" from memory 10 to continue the 
parsing operation from tiie point at which the parsing 
was prevk)usly interrupted. Then, at the time the next 
stream is to be parsed, parser 17C stores the result of 
45 the parsing operation so far obtained in tiie portion of 
the table having the packet identification information 
PID set at "1," and proceeds to parse the next data 
stream. By repeating the processing as described 
above, parser 17C parses the data streams to be sub- 
so jected to the splicing operation in a time division multi- 
plexed fashion. When the parsing operation is 
eventually completed, the parsing results for each 
packet identification information PID stored in status 
table 17A are sent to buffer simulator unit 18. 

55 

(5) Configuration of Data Link Circuit 

[0077] Data link circuit 19 will be described, making 
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reference to Rg. 15 in addition to Rg. 6. In splicing 
apparatus 1 constructed in accordance with an ennbod- 
iment of the invention, in response to the parsing results 
received from buffer simulator 18, CPU 7 determines a 
splice point at which a splicing operation is to be per- 5 
formed. CPU 7 also determines whether or not b»lanking 
data and/or stuffing data shoUd be inserted at the splice 
point. CPU 7 sends the determination results to data 
link circuit 19 as a data splicing instruction. Upon receipt 
of the data splicing instruction, data link circuit 19 exe- w 
cutes the splicing operation for video data of streams to 
be subjected to the splicing operation. 
[0078] The determination as to whether or not blank- 
ing data and/or stuffing data should be inserted at the 
link point of the spliced data stream is made based on is 
an occupancy of the VBV buffer on the receiver/decoder 
side upon receipt of the spliced data stream. Specifi- 
cally, if the splicing operation will cause an underflow of 
the VBV buffer that stores the spliced stream, blanking 
pictues may be inserted to increase the occupancy of 20 
the VBV buffer. Conversely, if the splicing operation will 
cause an overflow of the VBV buffer, stuffing data con- 
sisting of values "0" may be inserted to decrease the 
occqsancy of the VBV buffer. In the example iUustrated 
in the aforementioned Figs. 7A to 7C. since the VBV 2s 
buffer may urxierflpw as a resiA of a splicing operation, 
three blanking pictures are Inserted between picture "n" 
and picture 1m". Inserting these blanMng pictures may 
in turn cause a sGght overt knv In the VBV buffer. There- 
fore, stuffing data is inserted with the last blanking pic- 30 
ture to reduce the occif)ancy of the VBV to the desired 
level. 

[0079] Referring to Rgs. 19 and 20, the procedure for 
determining the number of blanking pictures and 
amount of stuffing data are to be inserted at the sp!k;e 35 
point will be nrv>re fully described. 
[0080] CPU 7 cabulates the number of blanking pic- 
tures to be inserted between a last picture "m" in the 
data stream to be positioned before the splice point and 
the first picture "n" in the data stream to be positioned 40 
after the splice point in the splicing operation. This 
determination is made based upon the occupancy value 
•'V(m)" of the VBV buffer of the last picture "m". the 
occipancy value "V{n)'* of the VBV buffer of the first pic- 
ture "n" and a number of encoding bits "GCm)" gener- 45 
ated by the process of encoding picture m. These 
variables are obtained from buffer simulator 18. The 
determination is made so that the buffer occupancy 
when picture n is decoded is equal to the buffer occu- 
pancy that would exist if no splicing operation had taken so 
place, and picture n were decoded during standard 
processing. These variables are also used to determine 
the number of stuffing bytes to be inserted in the blank- 
ing picture. Thus, the number of blanking pictures and 
stuffing bytes are selected so that the buffer occupancy 55 
at the beginning of the data stream positioned after the 
splice point matches the actual required and expected 
buffer occupancy of the data stream positioned after the 
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splice point so that the VBV buffer does not underflow or 
overflow. 

[0081 ] As is shown in Rg. 1 9, and the flowchart of Rg. 
20, at step SI the occupancy of the VBV buffer of a pic- 
ture that is to be decoded at time t^ is determined in 
accordance with the equation 

V(t 0 = V(m)-G{m)+R/30 , where V(ti) is the occupancy 
of the VBV buffer at time t-i, and V(m) is the occupancy 
of the VBV buffer for picture "m". G(m) is the number of 
encoding bits generated by the encoding process of 
encoding picture "m". and R/30 represents that a picture 
is output each 1/30 of one second, where "R* is the 
bitrate of the data streams. In Rg, 19. the value V(ti) is 
determined. V(ti) is essentially the value of the VBV 
buffer at the last timing less the data removed for decod- 
ing, plus the data added to the VBV buffer for the next 
picture. 

[0082] Then, at inquiry step ST2 the calculated occu- 
pancy of the VBV buffer at time t^ (V(ti)) is compared to 
the desired occupancy of the VBV buffer at picture to 
determine if the buffer occupancy at time t^ is greater. If 
the inquiry is answered in the negative, and the occu- 
pancy of the VBV buffer is not greater, then the pucture 
output at time ti is a blanking picture as shown at step 
ST3. Then at step ST4, the counter V is increased by 
1 , and the procedure returns to step ST1 , and the calcu- 
lation rioted above is repeated for time ^ and further 
time periods as is necessary. 
[0083] This procedure continues until the inquiry at 
step ST2 is answered in the affirmative, that is the occu- 
pancy of the VBV buffer at the presently measured tim- 
ing is greater than the desired occupancy of the VBV 
buffer at pk;ture "n". control then passes to st^ ST5. 
This is shown in Rg. 1 9 at time t^. where V(t4) is greater 
than V(n). At step ST5. it is then determined that no 
additional blanking pictures are required, and the next 
picture that is output will be picture 'n'. 
[0084] Control then proceeds to step ST6, where a 
number of stuffing bytes necessary to reduce the actual 
VBV buffer occupancy to the desired VBV buffer occu- 
pancy of picture n is determined. This is necessary 
because the insertion of the third blanking picture may 
cause an overflow of the VBV buffer in the near future 
because the occupancy value V(t4) is greater than V{n). 
The number of required stuffing bytes is determined in 
accordance with the formula Q(SF) « V(t4)-V{n) . Sim- 
ply, the nurriser of stuffing bytes (G{SF)) equals the 
amount of the occupancy of the VBV buffer at time t4 is 
greater than the desired occupancy of the VBV picture 
"n". After this determination, at step ST7, these stuffing 
bytes are added to the VBV buffer prior to the input of 
picture "n" so the desired VBV buffer occupancy is 
achieved- This is shown in Fig. 19 as the addition of 
bytes G(SF). so that the occupancy of the VBV buffer at 
t4 equals the desired occupancy for picture "n". Thereaf- 
ter, further pictures in the data stream are input to, and 
decoded from, the VBV buffer without danger that the 
buffer will underflow or overflow. 
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[0085] The specific configuration of data link d rcuit 1 9 
is illustrated in Fig. 15. Data iink circuit 19 first inputs a 
data splicing instruction D|st supplied thereto from CPU 
7 to an instructbn buffer 70. The data splicing instruc- 
tion DtsT also includes information relating to locations s 
in memory 10 at which data to be spliced in accordance 
with the splicing operation are stored, information on the 
amounts of thanking pages and stuffing data to be 
inserted, information on locations in memory 10 at 
which spliced data is stored, and so on. w 
[0086] An instruction analysis circuit 71 reads and 
analyzes the data splicing instruction D|sy stored in 
instruction buffer 70, and outputs storage location infor- 
mation for video data to be subjected to a splicing oper- 
ation. The information obtained as a result of the is 
analysis is output to a read address generator 73. 
Instruction analysis circuit 71 also outputs storage loca- 
tion infornration on the k)cation where video data will be 
stored after the splicing operation to a write address 
generator 74. and outputs information Indicative of the 20 
contents of the splicing processing procedure to a con- 
trol circuit 75. Control circuit 75 controls the general 
operation of data link drcuit 19. Control circuit 75 sends 
control data in accordance with the contents of the splic- 
ing processing procedure supplied thereto from instruc- 25 
tion analysis circuit 71 to a data processing circuit 76 
and a selector 77. Data processing drcuit 76 and selec- 
tor 77 execute the data splidng processing procedure 
as instructed by CPU 7. Control drcuit 75 also sends 
read/write (W/R) nfKxie information for specifying a read so 
mode or a write mode to memory 10 simultaneously 
with the output of an address from read address gener- 
ator 73 or write address generator 74. 
[0087] Read address generator 73 generates address 
information irxiicative of k>cations at wNch video data is 3$ 
stored in memory 10 based on location information for 
the video data to be subjected to the splidng operation, 
and sends these addresses to memory 10 as a read 
address Dadri- Video data DA and DB to be subjected 
to the splidng operation are read from the memory 10 40 
based on the read address Dadri and mode informa- 
tion W/R output from control drcuit 75. When the video 
data DA and DB are read from memory 1 0, pointer infor- 
mation stored together with assodated TS packets are 
used to read the desired video data from predetermined 45 
positions within the TS packets. The video data DA and 
DB read in this manner comprise video data in a form 
similar to that of elementary stream data. Video data DA 
and DB, read from memory 1 0 and to be subjected to 
the splicing operation, are input to data buffers 78. 79, so 
respectively. Blanking data Dblk generated by t)lanking 
generator 20 is also input to a data buffer 80. 
[0088] Selector 77 selects data to be processed by the 
splicing operation based on control data forwarded from 
control circuit 75. and stores the selected data in a data ss 
buffer 81 . More specffically, selector 77 reads the video 
data DA and DB as required for the splicing operation 
that are stored in data butlers 78. 79. The selected 
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video data read out from the respective buffers is then 
stored in data kxjffer 81 . Selector 77 then reads a prede- 
termined number of sheets of blanking data Dq^k stored 
in the data buffer 80 and stores the read out blanking 
data Dblk data buffer 81 as well. Finally, a desired 
amount of stuffing data D^f produced by stuffing gener- 
ator 21 is retrieved and is also stored in data buffer 81. 
The amount of iDlanking data and stuffing data is deter- 
mined as described above. 

[0089] Data processing circuit 76 then reads video 
data DA and DB, thanking data Dblk stuffing data 
□sF stored in data buffer 81 , based on control data from 
the control circuit 75. and splices these data portions 
together to produce a spliced video data sequence 
which is then transformed into TS packetized spliced 
video data DA-t-B. The TS packetized spliced video data 
DA+B is again stored in data buffer 81. Consequently, 
the spliced video data DA+B is read from data buffer 81 
and supplied to memory 10 together wKh a write 
address D^owi generated by write address generator 
74 and mode infornr^tion W/R indicating a write opera- 
tion, and stored at a location specified by the write 
address Dadwi- 

[0090] When a plurality of data splidng instructions 
D|ST are fed to instruction buffer 70, control drcuit 75 
outputs a read instruction to instruction buffer 70 to read 
each next data combination instruction, one at a time, 
and proceeds with the processing in a simaar manner 
for each data splidng instruction. Data link drcuit 19 
reads the video data DA and DB to be subjected to a 
splidng operation from memory 10 based on a data 
splicing instruction D|st from CPU 7, retrieves the 
blanking data Dblk ^ stuffing data Dgp if required, 
and links these data to produce a spliced video data 
DA+B which is then stored again in menrx)ry 10. 

(6) Method of Generating Blanking Data 

[0091 ] A method of generating blanking data DBLK in 
the blanking generator 20 will now be described, refer- 
ring once again to Fig. 6. Blanking generator 20 is 
adapted to produce blanking data Dblk ^ consisting all 
macroblocks only of DC values for intra-frame coded 
pictures. Also, for inter-frame predictive coded pictures 
sukjsequent to the intra-frame coded pictures, the blank- 
ing generator 20 produces blanking data D^lk 
ting a differential value between a macroblock and a 
reference macroblock and a motion vector to zero or by 
forming a picture of skipped macroblocks. 

(7) Configuration of Output Processor 

[0092] Output prcxessor 23 will now be described 
making reference to Fig. 16 in addition to Fig. 6. Output 
processor 23 reads and outputs TS packets of a spliced 
program and TS packets of other programs to be multi- 
plexed together with the spliced program from memory 
10 based on a scheduling list created by the scheduler 
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circuit 24 to produce a multiplexed transport stream 
Squt- 

[0093] TS packets of programs not subjected to splic- 
ing are free from any processing within splicing appara- 
tus 1. Such TS packets may be output from splicing s 
apparatus 1 subfect only to a delay corresponding to a 
system delay caused by splicing apparatus 1 so that 
these TS packets are output at a proper timing as com- 
pared with TS packets that are subjected to a splicing 
operation. For providing such a delayed output, if the ro 
time a TS packet was input to splicing apparatus 1 is 
known, the TS packet nf«y be output at a desired time 
according to the system delay. Thus, once the system 
delay has elapsed after the input time for a particular TS 
packet the delayed TS packet may be output, realizing is 
the delayed output. For this purpose, a system time 
clock STC Is added to each of the TS packets in the 
input processors ISA, 15B when input to splicing appa- 
ratus 1. The input time is thus registered in each TS 
packet, such that the value of the system time dock 20 
STC indicative of the input time is used to determine 
output time information in the scheduling fist. 
[0094] The configuration of output processor 23 for 
perfomfiing such processing will be desafced nmking 
specific reference to Fig. 16. As iQustrated in Rg. 16, in 2s 
output processor 23, a scheduling list data Dslst 
received from scheduler circuit 24 is input to a Ost buffer 
90. The scheduGng list stored in list buffer 90 includes 
information for specifying the output time information for 
each TS packet to be output The output time infonna- so 
tion consists of the value of the system time dock STC 
indicative of the input time of the TS packet. List buffer 
90 reads the scheduling list in response to a read (^or- 
ation specified by a read pointer 91 , and sends the entry 
information in tiie read list to an address generator 92, 35 
and sends output time infbnmation Djq to a comparator 

94 through a latch drcuit 93. 

[0095] Address generator 92 generates a read 
address Daors for a TS packet specified by the entry 
information supplied thereto from list buffer 90, and sup- 40 
plies tiie read address Dadr2 ^ memory 10. In 
response, a TS packet Ojsz to be output from splidng 
iapparatus 1 specified by the entry information is read 
from memory 10. A buffer 95 receives the TS packet 
Djs2. and writes the TS packet Dts2 an area of buffer 45 

95 specified by a write counter 96. 

[0096] A delay con'edion drcuit 98 is loaded with a 
current value of the system time clock STC. Delay cor- 
rection circuit 98 subtracts the value of the system delay 
as a result of propagation of the signal through splicing so 
apparatus 1 from the value of the system time clock 
STC to derive the value of a corrected system time clock 
STC which is output to comparator 94 as time informa- 
tion DsTc- 

[0097] Comparator 94 determines whether or not the 55 
time information Dgjc output from delay correction cir- 
cuit 98 matches the output time information Dyo of the 
TS packet supplied thereto through latch circuit 93. If 



the two time information match, an output signal at level 
"H" to a read counter 97 is output from comparator 94. 
Thus, it is determined that the corrected time informa- 
tion DsTc 'S coinddent with the output time information 
Dxo In this case, the delayed time from the input of the 
TS packet has been reached. 

[0098] A read counter 97 specifies an area of buffer 95 
from which information is to be read by outputting a con- 
trol signal for spedfying a read area to buffer 95 in 
response to an output signal from conparator 94. Con- 
sequently, as buffer 95 reads TS packets in response to 
the control signal, the TS packets specified by the 
scheduling list is output from output processor 23. 
[0099] When buffer 95 completes a read operation, 
read counter 97 notifies read pointer 91 of the comple- 
tion of the read operation. In response to this notifica- 
tion, read pointer 91 instructs list buffer 90 to read tiie 
next entry information and the output time information 
Dto- Consequentiy, the processing as desaibed above 
is repeated in order to read consecutive TS packets 
specified by the scheduling list in order, thereby output- 
ting tine transport stream Squt which has multiplexed 
tfierein TS packets of a spliced program and TS packets 
of other programs not subjected to a splicvig operation. 

(8) Processing Procedure for Splidng Operation 

[0100] A processing procedure for performing the 
splidng operation on accordance with an embodiment 
of the invention will now be described making reference 
to the ffow chart of Fig. 17. As illustrated in Fig. 17, the 
procedure begins at step SP1 , and at step SP2, each of 
a plurality of TS packets of received input transport 
streanrts S10, S11 are rearranged in accordance with 
packet identification information PID t>y input proces- 
sors 15A. 15B. The rearranged TS packets are then 
stored in memory 10 in the reananged form in accord- 
ance with each packet identificatfon infornuttion PID. 
Processing tiien proceeds to step SP3. At step SP3, 
parser unit 17 of splicing apparatus 1 parses the syntax 
of the two source video streams of video data to be sub- 
jected to a splidng operation, as specified by host com- 
puter 2. At next step SP4. buffer simulator unit 18 of 
splicing apparatus 1 analyzes the amount of code tfiat 
would be generated in tiie VBV buffer when the video 
data to be subjected to splidng is input thereto, based 
on the parsing result from parser unit 1 7. 
[01 01 ] Upon completion of the above steps, the splic- 
ing apparatus 1 simultaneously proceeds to steps SP5 
and SP10 to perform respective processing in parallel. 
At step SP5, CPU 7 determines how splicing processing 
should be performed on the source video stream to be 
subjected to splicing to generate splicing instructions 
based on the analysis result of buffer sirrxjlator 18. CPU 
7 in turn controls blanking generator 20 to generate a 
required number of blanking pictures Dq^k which are to 
be inserted at a splice point between two data streams 
to be spliced together, based on the splicing instruction. 
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At next step SP6, data link circuit 19 reads video 
streams DA and DB to be subjected to splicing from 
memory 10, and splices video data DA and DB while 
inserting the blanking picture Dblk stuffing brts Dsf 
as appropriate to produce spited video stream DA+B. 
This linked video data is again transformed into TS 
packets and stored in memory 10. At next step SP7. 
time stamp regenerator 22 adds new time stamps to 
each of the TS packets positioned after the splice point 
such that the time stanps are continuous from before 
until after the splice point 

[01 02] While steps SP5-SP7 are being performed, at 
step SP10, scheduler circuit 24 schedules the output 
timing for TS packets which are to be output from splic- 
ing apparatus 1. A scheduling list indicative of the out- 
put scheduling is created. Since splicing apparatus 1 
multiplexes and outputs the TS packets of other video 
streams that have not been subject to a splicing opera- 
tion, instead of only outputting the TS packets of the 
spliced video stream DAB, the output timing for all TS 
packets to be output are defined in the scheduling list. 
[0103] At step SP8, output processor 23 reads TS 
packets specified by the scheduling list from memory 10 
in the listed order, and outputs the read out TS packtis 
at the specified timing. The scheduled output tinting is 
based upon the scheduling list An output transport 
stream Sq^ is produced, and which Includes TS pack- 
ets of the spliced video stream DAB, and TS packets of 
the video data that have not been subject to a splicing 
operatton. multiplexed therein. 
[01 04] At next step SP9. PCR regenerator 25 con-ects 
the value of the program dock reference PCR such that 
new program clock reference PCR added to transport 
stream Squt output from output processor 23 is com- 
pletely continuous. Thus, a transport stream Squt 
produced and output. After the processing at step SP9 
ends, splk:ing apparatus 1 retunns to step SPI to per- 
form a further splicing operation, or to terminate opera- 
tion. 

[0105] Splicing apparatus 1 is adapted to perform a 
splicing operation through a sequence of processing 
including storage of input transport streams, parsing of 
data streams to be subjected to splicing, execution of an 
actual splicing operation without decoding and re- 
encodng the transported data, scheduling for TS pack- 
ets to be output, and outputting of TS packets based on 
the scheduling. 

[0106] Figs. ISA to 181 illustrate timing charts for 
respective processing by the various described compo- 
nents of splicing apparatus 1 . As illustrated in the afore- 
mentioned flow chart, in splicing apparatus 1, TS 
packets are output therefrom, in accordance with a 
sequence of processing performed In the respective 
components. For this reason, splicing apparatus 1 gen- 
erates a system delay as shown in Figs. 18A to 181. In 
Figs. 1 8A to 181. same data belonging to a similar group 
is represented by the same hatching. As can be seen 
from the liming chart, data P, which is stored in the 



memory 10 by input processor ISA (or 15B) at time 
point tlO, is output from the splicing apparatus 1 at time 
point t11. so that a system delay /ct (=t11-t10) exists. 
Therefore, delay correction circuit 98 in the output proc- 
5 essor 23 offsets the value of the system time dock STC 
by this system delay f^X. Thus, TS packets that are sub- 
jected to a splicing operation, and TS packets that are 
not subjected to a splicing operation are output from 
splicing apparatus 1 after a similar delay. 

10 

(9) Operation and Effects 

[01 07] In splicing apparatus 1 configured as described 
above in accordance with an embodiment of the inven- 

15 tion, nnutti-program transport streams S10, S11, in 
which digital video data of a plurality of programs are 
multiplexed, are input to Input processors 15A. 15B. 
Input processors ISA. 1SB rearrange respective TS 
packets from transport streanns SI 0, 31 1 in accordance 

20 with the pad^ identtfrcation informatfon PID and store 
the rearranged TS packets in memory 10 accading to 
each packet identifk:ation infonrtatfon PID. to reconfig- 
ure and group TS packets for each program. 
[Ql 08] For actually performing the splidng operation. 

25 parser unit 1 7 reads TS packets of video data to be sub- 
jected to the spGcing operatfon. and parses a variety of 
syntax parameters added to the TS packets during 
compression encoding and packetization. Buffer simu- 
lator unit 18 receives the result of the parsing, and sim- 

30 ulates how the VBV buffer on the receiver side woukl 
behave when data streams that are to be subjected to 
splicing are received. 

[01 09] CPU 7 receives the result of the simulation per- 
formed by buffer simulator unit 18, determines which 
35 appropriate data combinatfon processing shouki be 
performed on the data streams to be subjected to splic- 
ing without causing the VBV buffer to overt kiw or under* 
flow, and sends the determination result to data link 
drcuit 19 as a splidng instruction. 
40 [0110] Data link circuit 19 reads TS packets of the 
streams to be sibjected to the splidng operation based 
on the data splicing instruction as received from CPU 7, 
and generates blanking pages Dqi^k ^ stuffing bytes 
Dsf 3^ appropriate. Data link drcuit 19 performs a splic- 
es Ing operation by splicing the appropriate packets and 
data, and transforms the spliced data back into TS 
packets which are again stored in memory 10. 
[0111] Scheduler circuit 24 schedules the output tim- 
ing for the spliced TS packets based on the result of 
50 analysis performed by buffer simulator unit 18 and the 
contents of determination for data combination made by 
CPU 7. Scheduler circuit also schedules the output tim- 
ing for TS packets of other streams not subjected to a 
splicing operation, if they are to be multiplexed and out- 
55 put together, with the spliced TS packets. 

[0112] Output processor 23 reads TS packets from 
memory 10 to be output from splicing apparatus 1 
based on a scheduling list as received from scheduler 
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circuit 24, and outputs the IS packets at the specified 
output timing. This results in a transport stream Sour 
which has multiplexed therein the spliced TS packets 
and the TS packets of the other data streams not sub- 
ject to a splicing operation. 

[01 1 3] Splicing apparatus 1 demultiplexes and classi- 
fies the input transport steams S10, S11, and stores 
the individual data streams in the memory 10. Thereaf- 
ter, memory 10 is commonly accessed by the respective 
components of splicing apparatus 1 to perform analysis 
of the streams, execution of a splicing operation, and 
outputting of spliced data streams, thereby making it 
possible to readily carry out the splicing operation even 
with video data which are packetized for transmission. 
[0114] Also, in splicing apparatus 1, when respective 
TS packets of the transport streams S10, S11 are 
stored in memory 10. pointer intonmation is added to 
each TS packet to point to positions at which associated 
information are contained within the packet. Accord- 
ingly, a desired portk}n in a TS packet can be easily 
accessed by referring to the appropriate pointer infor- 
mation. It is therefore possible to handle the TS pack^ 
as if they were in the format of elementary streams with- 
out the need for actually disassembling and decoding 
them into elementary streams. 
[01 1 5] Further, in splicing apparatus 1 . when transport 
streams S10, S11 are staed in nnemory 10, an input 
time thereof is added to the transport streams. There- 
fore, if the transport streams S10. 811 are output at a 
delayed timing equal an inherent system dels^ from the 
input time, they can be properly output whfle preventing 
the VBV buffer from failing without the need for resched- 
uling the output thereof. 

(10) Other Embodimwits 

[0116] While the foregoing embodiment has been 
desabed for the case where TS packets of a spliced 
stream are muttipiexed witii TS packets of other streams 
and the nujltiplexed transport stream is output, tiie 
present Invention is not limited to this. Alternatively, the 
TS packets of the spliced stream only may be output. 
[01 1 7] Also, while in the foregoing enrt)odiment, each 
of the components has been described as being an 
independent module, the present invention is not limited 
to this configuration, but some of the components may 
be collected and fomned by a single module. 
[0118] Further, in tfie foregoing embodiment single 
memory 10 can be commonly accessed by the respec- 
tive components through bus 9 in order to absorb 
processing times in the respective components. The 
present invention, however, is not limited to this configu- 
ration, and alternatively, a first in first out (FIFO) buffer 
may be provided between the respective components to 
absorb the processing times in the respective circuit 
blocks. 

(01191 Further, in the foregoing embodiment, input 
transport streams are rearranged in accordance with 



the packet klentification information PID and grouped 
and stored in memory 10 according to packet identifica- 
tion information PID to classify and rearrange the trans- 
port streams. The present invention is not limited to 

5 such a manner of classification. Alternatively, the input 
transport streams may be stored in memory in tfieir 
received groupings or order, and be classified in accord- 
ance wrtii pointer information based on the packet iden- 
tification information PID. 

10 [0120] Furtiier, in the foregoing embodiment, when 
the input transport streams are demultiplexed, and the 
data for each stream is stored together, pointer informa- 
tion indicative of storage locations for a variety of infor- 
mation is added to each stream such that ttie streams 

15 are disassembled into pseudo elementary streams. The 
present invention, however, is not limited to such 
pseudo disassemble. Alternatively, tiie respective 
streams may be actually disassembled Into elementary 
streams. 

20 [0121] Further, while the foregoing embodiment has 
been described for parallel use of four tables TBI to 
TB4 in ttie PID lookup tables 16A, 16B, tfie present 
invention is not limited to tills particular number of 
tables. Any number of parallel tables may be used; In 

25 addition, the PID lookiip table may be structured by 
direct mapping in accordance with a cache scheme, or 
N-way associative, by way of example. 
[01 22] Furtfier. while the foregoing embocfiment has 
been descrbed for ttie case where an input time is reg- 

30 istered in ttie scheduling list, ttie present invention is not 
limited to tiie registi^tion of ttie output time in ttie sched- 
uling Gst. Alternatively, the output time may be regis- 
tered in each TS packet as part of additional 
information. 

35 [0123] According to embodiments of the present 
Invention as described above, respective encoded video 
data streams within an input transport stream are disas- 
sembled into respective pseudo original elementary 
streams and stored in storage means. The amount of 

40 code tiiat will be generated in a receiver's VBV buffer for 
streams to be subject to splicing linkage in ttie plurality 
of elementary streams is analyzed, and the streams to 
be subjected to a splicing procedure are spliced 
together on the basis of the result of the analysis. A 

45 desired amount of data is inserted at a splice point 
between the two data streams to be spliced to produce 
a spliced video data stream. The spliced video sf eam is 
output in accordance with output timing determined on 
tiie t^sis of the amount of code to be generated for the 

so spliced video data stream. It is thereby possible to read- 
ily carry out data connection processing even with video 
data which is packetized for transmission. 
[0124] Although particular embodiments have been 
described herein, it will be appreciated that the inven- 

55 tion is not limited thereto and that many modifications 
and additions thereto may be made within the scope of 
tine invention. For example various combinations of the 
features of the following dependent claims can be made 
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with the features of the independent claims without 
departing from the scope of the present invention. 
[01 25] Further, since certain changes may be made in 
carrying out the above method and in the constructions 
set forth without departing from the spirit and scope of s 
the invention it is intended that all description shown in 
the accompanying drawings shall be interpreted as 
illustrative and not in a limiting sense. 
[01 26] It is also to be understood that the following 
claims are intended to cover all of the generic and spe- io 
Cffic features of the invention herein described and all 
statements of the scope of the invention which, as a 
matter of language, might be said to fall therebetween. 

Claims is 

1 . A video splicing apparatus for receiving a transport 
stream including a plurality of packetized encoded 
video data streams, and for splicing said encoded 
video data streams to generate a spliced video data 2o 
stream, comprising: 

input processing means for disassembling 
each of said plurality of packetized encoded 
vkleo data streams in said transport stream 25 
into a pseudo-elementary stream before pack- 
etization. and storing said disassembled 
pseudo-elementary streams in predetermined 
storage mocuis; 

analysis means for analyzing the amount of 30 
coded bits of two data streams of said elemen- 
tary streams stored in said storage means that 
woutel be generated upon decoding upon 
receipt of the two data strean^ to be subjected 
to a splicing operation; 35 
data processing means for reading said data 
streams to be subjected to said splicing opera- 
tion from said storage means* splicing said 
streams, and inserting a desired amount of 
additional data at a splice point based on the 40 
result of the analysis by said analysis means to 
produce a spliced video data stream, and stor- 
ing said spliced video data stream in said stor- 
age means; and 

output processing means for determining out- 45 
put timing for said spliced video data stream 
based on said amount of coded bits deter- 
mined by said analysis means, and outputting 
said spliced video data stream read from said 
storage means based on said determined out- so 
put timing. 

2. The video splicing apparatus according to claim 1 , 
wherein: 

55 

said input processing nneans rearranges said 
respective encoded video data streams in 
accordance with packet identification informa- 
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tion while adding pointer information to each of 
said encoded video data streams, and stores 
said encoded video data streams in said stor- 
age means to disassemble said respective 
encoded video data streams into said pseudo- 
elementary streams. 

3. The video splicing apparatus according to claim 2. 
wherein: 

said input processing means comprises a plu- 
rality of tables having address information 
arranged in accordance with the packet identi- 
fication information oon^esponding to storage 
locations of said storage means, and wherein 
said video splicing apparatus retrieves address 
information corresponding to packet identifica- 
tion Information of an input data stream while 
referencing said plurality of tables in parallel, 
and rearranges said respective encoded video 
data streams in accadance with the packet 
identification information and stores the rear- 
ranged video data streams in said storage 
means based on said address information. 

4. The video splicing apparatus according to any pre- 
ceding daim. wherein: 

said data processing means inserts a desired 
number of blanking pictures and stuffing bits as 
said additional data such that a buffer in a 
decoder that will receive and decode the 
spliced data stream side does not overt k>w or 
underflow, based on the amount of data that 
would be generated in said decoder for each of 
said data streams subjected to the spiking 
operation. 

5. The video splicing apparatus according to any pre- 
ceding claim, wherein: 

said analysis means analyzes at least two or 
more video data streams to be subjected to 
splicing in a time division manner. 

6. The video splicing apparatus according to any pre- 
ceding claim, wherein: 

said output processing means further includes 
time stamp adding means for adding new time 
stamps such that said time stamps are continu- 
ous before and after said splice point in said 
spliced video data stream. 

7. The video splicing apparatus according to any pre- 
ceding claim, wherein: 

said output processing means further includes 
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program clock refererrce correcting mearre for 
correcting a program clock reference in said 
output spliced video data stream. 

8. The video splicing apparatus according to dalm 7. 
wherein: 

said program clock reference conecting means 
con-ects said program dock reference based 
on a difference in time between said output tim- 
ing after splidng and an output timing that 
would be used if the data had not been spliced. 

9. The video splicing apparatus according to any pre- 
ceding claim, wherein: 

said input processing means stores an input 
time at which each packet of said respective 
encoded vkieo data streams was input associ- 
ated with each packet of said encoded data 
streams. 

10. The video splicing apparatus according to daim 9, 
wherein: 

when said encoded video data streanns not 
subjected to a splidng operation are output 
together wHh saki spSced video data stream, 
said output processing means specifies output 
timing for saki encoded vkleo data stream not 
subjected to the splidng operation, said output 
tinring being related to said input time. 

11. A video splidng mettiod for receiving a transport 
stream induding a plurality of packetized encoded 
vkleo data streams, and for splicing sakl encoded 
video data streams to generate a spliced vkleo data 
stream, comprising the steps of: 

disassembling each of said plurality of pack- 
etized encoded video data streams in said 
transport stream into a pseudo-elementary 
stream before packetization; 

storing said disassembled pseudo-elementary 
streams: 

analyzing the amount of coded bits of two of 
said pseudo-elementary streams that would be 
generated upon decoding upon receipt of the 
two data streams to be subjected to a splicing 
operation; 

reading said data streams to be subjected to 
the splicing operation; 

splicing said data streams; 



inserting a desired amount of additional data at 
a splice point based on the result of said analy- 
sis to produce a spliced video data stream. 

5 storing said spliced video data stream: 

determining output tinreng for said spliced video 
data stream based on said determined amount 
of coded bits; and 

10 

outputting said spliced video data stream 
based on said determined output timing. 

12. The video splidng method accorcfing to claim 11, 
15 wherein: 

said respective encoded video data streams 
are rearranged in accordance with packet klen- 
tification informatk)n while adding pointer infbr- 
20 mation to each of said encoded vkJeo data 

streams, and said encoded video data streams 
are disassembled into-pseudo elementary 
streams and are stored. 

25 13. The video splidng method according to claim 12, 
further comprising the steps of: 

provkling a plurality of tables having address 
infbrmatbn corresporxiing to storage kx^ations 
30 of said encoded video data streams arranged 

In accordance with the packet identification 
infomDatk)n; 

retrieving address information while referenc- 
ing saki plurality of tables in parallel; 
35 reananging said respective encoded video 

data streams in accordance with the packet 
Klenttficatk>n infonmation and 
storing the rearranged video data streams 
based on said address information. 

40 

14. The vdeo splicing method according to any of 
daims 1 1 to 13. further comprising the step of: 

inserting a desired number of blanking pages 
45 arxf stuffing data such that a buffer in a decoder 

that will receive and decode the spliced data 
stream side does not overflow or underflow, 
based on the amount of data that would be 
generated in said decoder for said data 
50 streams subjected to the splicing operation. 

15. The video splicing method according to any of 
daims 11 to 14, further comprising the step of: 

55 analyzing at least two or more video data 

streams to be subjected to splicing in a time 
division manner. 
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1 6. The video splicing method according to any of buffer which stores said spliced video stream 

claims 1 1 to 15, further comprising the step of: does not overflow or underflow. 



adding new time stanps to said spliced video 
data stream such that said time stamps are s 
continuous before and after said splice point in 
said spliced video data stream. 

17. The video splicing method according to any of 
claims 1 1 to 16, further comprising the step of: 

conecting a program clock reference in said 
output spliced video data stream. 

18. The video splicing method according to claim 17, is 
wherein: said program dock reference con-ecting 
step corrects said program clock reference based 

on a difference in time between said output timing 
after splicing and an output timing that would be 
used if the data had not been spliced. 20 



22. The splicing apparatus according to daim 21, 
wherein: 

said parser means simulates a bit occupancy 
value of a codec buffer holding said first coded 
stream and a bit occupancy of a codec buffer 
holding said second coded stream based on 
the result from said parsing means. 

23. The splicing apparatus according to daim 22, 
wherein: 

said control means controls sad splice means 
so that said bit occupancy value of said codec 
buffer holding said spliced video data stream 
equals said bit occupancy value of said codec 
buffer holding said second coded stream. 



19. The video splicing method according to any of 
daims 1 1 to 18, futher comprising the step of: 

storing an input time at which eacK packet of 
saki respective encoded video data streams 
was input associated with each packet of said 
encoded data streams. 

20. The vkleo splidng method according to claim 19, 
wherein: 

when sad encoded vdeo data streams not 
subjected to a splidng operation are output 
together with said spliced vkleo data stream, 
output timing for sa'd encoded video data 
stream not subjected to splidng is specified in 
. accordance with sad input time. 

21. A splidng apparatus for splicing together a first 
coded video stream ard a second coded video 
stream, conprising; 

parser means for parsing a syntax of said first 
coded video stream and a syntax of said sec- 
ond coded video stream; 
splice means for splidng said first coded video 
stream and said second coded video stream at 
a splicing point to generate a spliced video 
stream; and 

control means for generating a splicing instruc- 
tion to be supplied to said splice means in 
accordance with a command from said parser 
means for controlling said splice means based 
on said splicing instruction so as to insert 
dummy bits between said first coded video 
stream arxl said second coded video stream in 
said spliced video stream so that a coding 
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24. The splicing apparatus according to daim 23 
wherein: 

sad dummy data comprises at least one of a 
t)lanlqng pk;ture and stuffing btte. 

25. The spfidng apparatus according to daim 24, 
wherein: 

sad control means calculates a number of sad 
blankng pictures and amount of sad stuffing 
bits based on a bit occupancy value of a last 
picture of said first stream and a k>it occupancy 
value of a first picture of sad second stream, 

26. The splidng apparatus according to daim 25. 
wher^n: 

said splice means inserts said blanking pic- 
tures in order to increase the bit occupancy 
value of sad codec buffer holding sad spliced 
video stream, and stuffs sad stuffing bhs in 
order to decrease the bit occupancy value of 
said codec buffer holding said spliced video 
stream. 

27. The splicing apparatus according to claim 26. 
wherein: 

said control means determines the amount of 
stuffing bits to be stuffed after the number of 
said t)lanKing pictures is determined. 

28. The splicing apparatus according to claim 22, 
wherein: 

said control means controls said splice means 
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SO that variations in the occupancy value of the 
codec buffer holding said spliced video stream 
agree with variations of said occupancy value 
of said codec buffer holding said second coded 
stream. 



ond coded video stream; 



5 



splice means for switching said first coded 
video stream and said second coded video 
stream at a splicing point to generate a spliced 
video stream; 



29. The splicing apparatus according to claim 21, 
wherein: 



said control means revises time stamps of said 
spliced video stream so that said time stamps 
of said second coded video stream within said 
spliced video stream are continuous from time 
stamps of first coded video stream within said 
spliced video stream. 



10 



control means for controlling said splice means 
so that variations in a buffer occupancy of the 
second coded video stream in said spliced 
video stream agree with variations of a buffer 
occupancy that would be present as a result of 
an original second coded video stream sup- 
plied to said splicing apparatus if said second 
coded video stream were not subjected to the 
splicing operation. 
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30. The splicing apparatus according to claim 21. fur- 
ther comprising: nnemory means for storing said 
first coded stream and said second coded stream; 

wherein said control means adds pointer 20 
information to first and second coded streams, 
wherein said pointer information indicates menx)ry 
address of codec parameters of said first and sec- 
ond coded streams stored in said memory means, 
and wherein said spKdng instruction is generated 25 
based on said codec parameters wtiich are read 
out from said menwry means by using said pointer 
information. 

31. A splicing apparatus for spltctng together a first so 
coded video stream and a second coded video 
stream, comprising; 

parser means for parsing a syntax of said first 
coded video stream and a syntax of said sec- 35 
ond coded video stream, 
splice means for switching said first coded 
video stream and said second coded video 
sti'eam at a splicing point to generate a spliced 
video stream; 4o 
control means for controlling said splice means 
to insert a number of dummy bits between said 
first coded video stream and said second 
coded video stream in said spliced video 
stream so that a buffer occupancy of a buffer 45 
holding said second coded video stream in said 
spliced video stream nnatches a buffer occu- 
pancy of said second coded video stream that 
would be generated if said second coded video 
stream were not spliced to said first coded so 
video stream. 

32. A splicing apparatus for splicing a first coded video 
stream and a second coded video stream, compris- 
ing; 55 

parser means for parsing a syntax of said first 
coded video stream and a syntax of said sec- 
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